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ACTIVE ALT TAG IN HTML DOCUMENTS TO INCREASE THE 
5 ACCESSIBILITY TO USERS WITH VISUAL, AUDIO IMPAIRMENT 

BACKGROUND OF THE INVENTION 

1. Technical Field: 

10 The present invention relates to computer network 

environments. More specifically, the present invention 
relates to accessing electronic documents. 

2. Description of Related Art: 

15 Information on the World Wide Web is typically made 

available by structuring the information into a visual 
presentation. Hypertext Markup Language (HTML) is used 
by the web author to define the visual structure. The 
end user is presented with this information by viewing 

20 the information on a computer display, after the 

information has been rendered into a visual format by a 
web browser (e.g. Netscape Navigator or Microsoft 
Internet Explorer) . 

Web pages are often created with various multimedia 

25 resources such as Video Clip, Audio, and Images. The web 
designer normally selects a primary format which will 
make the maximum impact on a normal user. Sometimes 
these multimedia formats may not be appropriate for users 
with various visual or hearing impairments. 

30 Currently, well designed web pages use the HTML ALT 

tags to specify alternate resource formats for a 
multimedia resource. For example, a video clip may be 
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specified as a primary format. The clip's text 
equivalent or audio version may be specified as the 
alternate format. Users, using the browser settings, may 
turn off the primary format and instead access the 
5 alternate format. However, the setting in a browser must 
be applied to the whole page, until the browser setting 
is changed. 

Therefore, a more flexible approach for selecting 
alternate web page formats would be desirable. 
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SUMMARY OF THE INVENTION 

The present invention provides a method, program and 
5 system for providing access to alternate formats within 
an electronic document. The invention comprises parsing 
a web page and creating a document object model (DOM), 
and then parsing the alternate format attribute of an 
image element within the DOM- A browser then displays 
10 the web page containing an image (or images) according to 
the default settings of the browser. A user interface is 
specified which allows the user to select alternate 
formats for the default image. This user interface may 
be in the form of a pop up menu that is presented to the 
15 user in response to an input command, such as a right 
mouse click on the default image. The user can then 
select an alternate format which replaces the original 
image in the web page. Alternate formats may include 
text, audio, or tactile formats. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the 
invention are set forth in the appended claims. The 
5 invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best 
be understood by reference to the following detailed 
description of an illustrative embodiment when read in 
conjunction with the accompanying drawings, wherein: 
10 Figure 1 depicts a pictorial representation of a 

network of data processing systems in which the present 
invention may be implemented; 

Figure 2 depicts a block diagram of a data processing 
system that may be implemented as a server in accordance 
15 with a preferred embodiment of the present invention; 

Figure 3 depicts a block diagram illustrating a data 
processing system in which the present invention may be 
implemented; 

Figure 4 depicts a block diagram of a browser 
20 program in accordance with a preferred embodiment of the 
present invention; 

Figure 5 depicts a block diagram illustrating a 
Document Object Model in accordance with the prior art; 
Figure 6 depicts a flowchart illustrating the 
25 processing of an HTML document in accordance with the 
prior art; 

Figure 7 depicts a flowchart illustrating the use of 
active ALT tags in accordance with the present invention; 
and 

30 Figure 8 depicts a pictorial diagram illustrating 

ALT menu on a web page in accordance with the present 
invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

5 With reference now to the figures, Figure 1 depicts a 

pictorial representation of a network of data processing 
systems in which the present invention may be implemented. 
Network data processing system 100 is a network of 
computers in which the present invention may be 

10 implemented. Network data processing system 100 contains 
a network 102, which is the medium used to provide 
communications links between various devices and computers 
connected together within network data processing system 
100. Network 102 may include connections, such as wire, 

15 wireless communication links, or fiber optic cables. 

In the depicted example, a server 104 is connected to 
network 102 along with storage unit 106. In addition, 
clients 108, 110, and 112 also are connected to network 
102. These clients 108, 110, and 112 may be, for example, 

20 personal computers or network computers. In the depicted 
example, server 104 provides data, such as boot files, 
operating system images, and applications to clients 
108-112. Clients 108, 110, and 112 are clients to server 
104. Network data processing system 100 may include 

25 additional servers, clients, and other devices not shown. 
In the depicted example, network data processing 
system 100 is the Internet with network 102 representing a 
worldwide collection of networks and gateways that use the 
TCP/IP suite of protocols to communicate with one another. 

30 At the heart of the Internet is a backbone of high-speed 
data communication lines between major nodes or host 
computers, consisting of thousands of commercial, 
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government, educational and other computer systems that 
route data and messages . Of course, network data 
processing system 100 also may be implemented as a number 
of different types of networks, such as for example, an 
5 intranet, a local area network (LAN) , or a wide area 

network (WAN) . Figure 1 is intended as an example, and not 
as an architectural limitation for the present invention. 

Referring to Figure 2, a block diagram of a data 
processing system that may be implemented as a server, 
10 such as server 104 in Figure 1, is depicted in accordance 
with a preferred embodiment of the present invention. 
Data processing system 200 may be a symmetric 
multiprocessor (SMP) system including a plurality of 
processors 202 and 204 connected to system bus 206. 
15 Alternatively, a single processor system may be employed. 
Also connected to system bus 206 is memory 
controller/cache 208, which provides an interface to local 
memory 209. I/O bus bridge 210 is connected to system bus 
206 and provides an interface to I/O bus 212. Memory 
20 controller/cache 208 and 1/0 bus bridge 210 may be 
integrated as depicted. 

Peripheral component interconnect (PCI) bus bridge 
214 connected to I/O bus 212 provides an interface to PCI 
local bus 216. A number of modems may be connected to PCI 
25 bus 216. Typical PCI bus implementations will support 
four PCI expansion slots or add-in connectors. 
Communications links to network computers 108-112 in 
Figure 1 may be provided through modem 218 and network 
adapter 220 connected to PCI local bus 216 through add-in 
30 boards. 

Additional PCI bus bridges 222 and 224 provide 
interfaces for additional PCI buses 226 and 228, from 
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which additional modems or network adapters may be 
supported. In this manner, data processing system 200 
allows connections to multiple network computers. A 
memory-mapped graphics adapter 230 and hard disk 232 may 

5 also be connected to I/O bus 212 as depicted, either 
directly or indirectly. 

Those of ordinary skill in the art will appreciate 
that the hardware depicted in Figure 2 may vary. For 
example, other peripheral devices, such as optical disk 

10 drives and the like, also may be used in addition to or in 
place of the hardware depicted. The depicted example is 
not meant to imply architectural limitations with respect 
to the present invention. 

The data processing system depicted in Figure 2 may 

15 be, for example, an IBM RISC/System 6000 system, a product 
of International Business Machines Corporation in Armonk, 
New York, running the Advanced Interactive Executive (AIX) 
operating system. 

With reference now to Figure 3, a block diagram 

20 illustrating a data processing system is depicted in which 
the present invention may be implemented. Data processing 
system 300 is an example of a client computer. Data 
processing system 300 employs a peripheral component 
interconnect (PCI) local bus architecture. Although the 

25 depicted example employs a PCI bus, other bus 

architectures such as Accelerated Graphics Port (AGP) and 
Industry Standard Architecture (ISA) may be used. 
Processor 302 and main memory 304 are connected to PCI 
local bus 306 through PCI bridge 308. PCI bridge 308 also 

30 may include an integrated memory controller and cache 

memory for processor 302. Additional connections to PCI 
local bus 306 may be made through direct component 
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interconnection or through add-in boards. In the depicted 
example, local area network (LAN) adapter 310, SCSI host 
bus adapter 312, and expansion bus interface 314 are 
connected to PCI local bus 306 by direct component 
5 connection. In contrast, audio adapter 316, graphics 

adapter 318, and audio/video adapter 319 are connected to 
PCI local bus 306 by add-in boards inserted into expansion 
slots. Expansion bus interface 314 provides a connection 
for a keyboard and mouse adapter 320, modem 322, and 

10 additional memory 324. Small computer system interface 

(SCSI) host bus adapter 312 provides a connection for hard 
disk drive 326, tape drive 328, CD-ROM drive 330, and DVD 
drive 332. Typical PCI local bus implementations will 
support three or four PCI expansion slots or add-in 

15 connectors . 

An operating system runs on processor 302 and is used 
to coordinate and provide control of various components 
within data processing system 300 in Figure 3. The 
operating system may be a commercially available operating 

20 system, such as Windows 2000, which is available from 
Microsoft Corporation. An object oriented programming 
system such as Java may run in conjunction with the 
operating system and provide calls to the operating system 
from Java programs or applications executing on data 

25 processing system 300. "Java" is a trademark of Sun 

Microsystems, Inc. Instructions for the operating system, 
the object-oriented operating system, and applications or 
programs are located on storage devices, such as hard disk 



30 



drive 326, and may be loaded into main memory 304 for 
execution by processor 302. 

Those of ordinary skill in the art will appreciate 
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that the hardware in Figure 3 may vary depending on the 
implementation. Other internal hardware or peripheral 
devices, such as flash ROM (or equivalent nonvolatile 
memory) or optical disk drives and the like, may be used 
5 in addition to or in place of the hardware depicted in 
Figure 3. Also, the processes of the present invention 
may be applied to a multiprocessor data processing 
system. 

As another example, data processing system 300 may 

10 be a stand-alone system configured to be bootable without 
relying on some type of network communication interface, 
whether or not data processing system 300 comprises some 
type of network communication interface. As a further 
example, data processing system 300 may be a Personal 

15 Digital Assistant (PDA) device, which is configured with 
ROM and/or flash ROM in order to provide non-volatile 
memory for storing operating system files and/or 
user-generated data. 

The depicted example in Figure 3 and above-described 

20 examples are not meant to imply architectural 

limitations. For example, data processing system 300 
also may be a notebook computer or hand held computer in 
addition to taking the form of a PDA. Data processing 
system 300 also may be a kiosk or a Web appliance. 

25 Turning next to Figure 4, a block diagram of a 

browser program is depicted in accordance with a 
preferred embodiment of the present invention. Browser 
400 includes a user interface 402, which is a graphical 
user interface (GUI) that allows the user to interface or 

30 communicate with browser 400, This interface provides 
for selection of various functions through menus 404 and 
allows for navigation through the navigation button 406 
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or selections. For example, menu 404 may allow a user to 
perform various functions, such as saving a file, opening 
a new window, displaying a history, and entering a URL. 
Navigation 406 allows for a user to navigate various 
5 pages and to select web sites for viewing. For example, 
navigation 406 may allow a user to see a previous page or 
a subsequent page relative to the present page. 
Preferences may be set through preferences 408. 

Communications 410 is the mechanism with which 

10 browser 400 receives documents and other resources from a 
network such as the Internet. Further, communications 
410 is used to send or upload documents and resources 
onto a network. In the depicted example, communication 
410 uses HTTP. However, other protocols are possible. 

15 Documents that are received by browser 400 are processed 
by language interpretation 412, which includes an HTML 
unit 414. Language interpretation 412 will process a 
document for presentation on graphical display 416. In 
particular, HTML statements are processed by HTML unit 

20 414 for presentation. 

Graphical display 416 includes layout unit 418, 
rendering unit 420, and window management 422. These 
units are involved in presenting web pages to a user 
based on results from language interpretation 412. 

25 Browser 400 is presented as an example of a browser 

program in which the present invention may be embodied. 
Browser 400 is not meant to imply architectural 
limitations to the present invention. Presently 
available browsers may include additional functions not 

30 shown or may omit functions shown in browser 400. As 

used herein, the term "browser" encompasses any software 
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application used to view or navigate for information or 
data (e.g., something that assist a user to browser) in a 
distributed data base where the distributed database is 
typically the Internet or World Wide Web. 

5 Referring to Figure 5, a block diagram illustrating 

a Document Object Model is depicted in accordance with 
the prior art. HTML, which is used to provide a visual 
structure to a web page, also provides a semantic 
structure to the page. Well known techniques exist for 

10 parsing an HTML source file into a parse tree, in which 
the various structural elements and relationships among 
the elements are apparent from the topology of the parse 
tree. The parse tree is also called a Document Object 
Model (DOM) . The document represented by DOM 500 has 

15 been parsed into its main components: HTML Document 
Element 501, HTML Title element 502, and HTML Image 
element 503. The HTML document element 501 is the root 
of the HTML document represented by DOM 500. In 
addition, Figure 5 depicts the attributes of image 

20 element 503. These attributes include source (SRC) 504 
and alternative (ALT) 505. 

The DOM is a standard developed at the World Wide 
Web consortium for a platform- and language-independent 
interface to the structure and content of HTML and 

25 Extensible Markup Language (XML) documents. DOM uses 
Object Management Groups Interface Definition Language 
(IDL-ISO 14750) to express its object types. In DOM, an 
HTML or XML document is represented as a hierarchical 
collection of Node objects. Nodes are joined together in 

30 parent/child relationships. The HTML components of DOM 
add functionality and convenience functions for HTML 
scripting applications. 
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Referring to Figure 6, a flowchart illustrating the 
processing of an HTML document is depicted in accordance 
with the prior art. When an HTML file is loaded, the 
browser parses the document source file and creates an 
5 input DOM structure in memory (step 601) . The browser 
formats the DOM structure by determining the output 
medium and assigning the appropriate attributes to the 
DOM elements (step 602) . The browser then populates the 
DOM with the elements (step 603) and renders the document 

10 objects in the requested medium (step 604) . 

The present invention provides an "ACTIVE" ALT tag 
for a multimedia resource that gives the user the ability 
to choose an appropriate format from a list of alternate 
formats. The list can be a pop up menu, an audio list, 

15 or a tactile menu. The tag can be activated by right 

clicking or double clicking on a mouse, or by any other 
means by which options and menus are usually accessed. 

Referring to Figure 7, a flowchart illustrating the 
use of active ALT tags is depicted in accordance with the 

20 present invention. Using the DOM from Figure 5, the 

browser is configured to parse the ALT attribute 505 of 
the HTML image element 503 (step 701) . A user interface 
is specified using XML-based User Interface Language 
(XUL) (step 702) . Open sours browser windows are often 

25 designed in XUL, which uses HTML/Cascading Style Sheets 
(CSS) and the DOM. Commands and actions for the windows 
are handled mostly with Javascript. Because the user 
interface is configurable through markup, it is not hard 
coded in the source. Instead it is loaded at runtime, 

30 enabling programmers to tweak the interface without 

having to recompile the source code. An example of a XUL 
script to add a pull down menu is as follows: 
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<window> 
<menubar> 

<menu name= " formats "> 
5 <menuitem name= "depth map" onclick^ 

^displaydepthmap [)"/> 

<menuitem name= "intensity map" onclick^ 
"displayintensitymap ( ) "/> 
</menu> 
10 </menubar> 
</window> 

The browser then displays the specified user 
interface (i.e. selection list box) (step 703), from which 

15 the user may select an alternative format (step 704) . 

The selected alternative format then replaces the primary 
format in the display area of the browser (step 705) . 
This step involves executing the Javascript associated 
with the list box element selected by the user. 

20 Referring now to Figure 8, a pictorial diagram 

illustrating ALT menu on a web page is depicted in 
accordance with the present invention. The web page 800 
has two multimedia resources: a video clip 801 and an 
image 802. In the present invention, after a web page is 

25 displayed, the user right clicks on an image he wants to 
view in an alternate format. The browser looks through 
the DOM of the page, picks up the Javascript associated 

with the image and pops up the corresponding XUL list 
30 box. The user then clicks on an element within the list 
box, which triggers (again by referring back to the DOM) 
another event associated with the item and replaces the 
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original image with the format chosen by the user. 

In the first instance, in default browser settings, 
the video clip format 801 is shown. If the user right 
clicks, for example, on video clip 801 a pop up menu 811 

5 appears containing alternate formats such as audio, jpeg, 
and text. The user may then select an alternate format 
from menu 811, which will replace the default video clip 
801 in the display. 

The other multimedia resource on web page 800 is an 

10 image 802. Like video clip 801, image 802 is the primary 
format selected by the default browser setting. Again, 
if the user right clicks on image 802 a pop up menu 812 
appears containing the alternate formats including text 
description, tactile transcoded depth map, and audio 

15 transcoded intensity map, which can be selected by the 
user to replace the default image 802. 

It should be pointed out that the alternate formats 
depicted in Figure 8 are merely examples, as is the use 
of right clicking with a mouse to view the ALT menu. 

20 Numerous alternate formats exist for multimedia resources 
on web pages, and are well known within the art, as are 
various methods for accessing pop up menus. In addition, 
the menu of alternate formats can be presented by non 
visual means, such as an audio or tactile menu. 

25 The present invention allows users to choose the way 

they want to access multimedia resources on a 
per-resource basis, depending on the options available. 

Users can also choose to access a given resource in 
30 multiple formats. The present invention is also useful 
to users without impairments because the ALT tag 
information is no longer buried in the HTML code. Users 
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can easily access the tag information to actively choose 
in which format they wish to access web page contents. 

It is important to note that while the present 
invention has been described in the context of a fully 

5 functioning data processing system, those of ordinary 
skill in the art will appreciate that the processes of 
the present invention are capable of being distributed in 
the form of a computer readable medium of instructions 
and a variety of forms and that the present invention 

10 applies equally regardless of the particular type of 
signal bearing media actually used to carry out the 
distribution. Examples of computer readable media 
include recordable-type media, such as a floppy disk, a 
hard disk drive, a RAM, CD-ROMs, DVD-ROMs, and 

15 transmission-type media, such as digital and analog 

communications links, wired or wireless communications 
links using transmission forms, such as, for example, 
radio frequency and light wave transmissions. The 
computer readable media may take the form of coded 

20 formats that are decoded for actual use in a particular 
data processing system. 

The description of the present invention has been 
presented for purposes of illustration and description, 
and is not intended to be exhaustive or limited to the 

25 invention in the form disclosed. Many modifications and 
variations will be apparent to those of ordinary skill in 
the art. The embodiment was chosen and described in 
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order to best explain the principles of the invention, 
the practical application, and to enable others of 
ordinary skill in the art to understand the invention for 
various embodiments with various modifications as are 
5 suited to the particular use contemplated. 



